1st off...baffles will not restrict cone movement. The cone moves within the basket so if the baffle fits around the speaker basket the cone will be ok.
i think your problem is either the speakers(within the baffles) is NOT airtight or you have the speakers wired out of phase.